A Second Law for Open Markov Processes
نویسندگان
چکیده
منابع مشابه
Accelerated decomposition techniques for large discounted Markov decision processes
Many hierarchical techniques to solve large Markov decision processes (MDPs) are based on the partition of the state space into strongly connected components (SCCs) that can be classified into some levels. In each level, smaller problems named restricted MDPs are solved, and then these partial solutions are combined to obtain the global solution. In this paper, we first propose a novel algorith...
متن کاملOptimal processes for probabilistic work extraction beyond the second law
According to the second law of thermodynamics, for every transformation performed on a system which is in contact with an environment of fixed temperature, the average extracted work is bounded by the decrease of the free energy of the system. However, in a single realization of a generic process, the extracted work is subject to statistical fluctuations which may allow for probabilistic violat...
متن کاملGeneralized Mass Action Law and Thermodynamics of Nonlinear Markov Processes
The nonlinear Markov processes are measure-valued dynamical systems which preserve positivity. They can be represented as the law of large numbers limits of general Markov models of interacting particles. In physics, the kinetic equations allow Lyapunov functionals (entropy, free energy, etc.). This may be considered as a sort of inheritance of the Lyapunov functionals from the microscopic mast...
متن کاملON THE INFINITE ORDER MARKOV PROCESSES
The notion of infinite order Markov process is introduced and the Markov property of the flow of information is established.
متن کاملA Quintuple Law for Markov Additive Processes with Phase-type Jumps
Weconsider aMarkov additive process (MAP)with phase-type jumps, starting at 0. Given a positive level u, we determine the joint distribution of the undershoot and overshoot of the first jump over the level u, the maximal level before this jump, the time of attaining this maximum, and the time between the maximum and the jump. The analysis is based on first passage times and time reversion of MA...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Open Systems & Information Dynamics
سال: 2016
ISSN: 1230-1612,1793-7191
DOI: 10.1142/s1230161216500062